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FOREWORD 


The  O.S.  Army  Recruiting  Command  (USAREC)  has  asked  N  W  Ayer  Incorpor¬ 
ated  to  study  the  effectiveness  of  the  Army's  national  recruitment 
advertising*  N  W  Ayer's  Marketing  Services  Department  undertook  this 
task  in  Septembert  1979,  with  guidance  from  DSAREC's  Program  Analysis 
and  Evaluation  Division.  In  addition,  their  assistance  in  acquiring, 
providing,  and  checking  data  and  data  sources  was  essential. 

VoIubm  I  is  the  Executive  Suamary  and  is  Intended  for  the  general 
reader  who  wants  an  overview  of  the  project's  objectives,  methods, 
and  key  findings.  This  summary  highlights  the  marketing  and 
financial  aspects  of  the  analysis. 

Volume  II  is  the  Main  Report  and  is  Intended  for  the  reader  who  wants 
to  fully  understand  the  details  of  the  project:  its  inception,  method¬ 
ology,  data,  results,  validation,  and  economic  implications. 

Volume  III  is  comprised  of  Appendices  Intended  for  the  specialist  who 
wants  to  thoroughly  analyse  the  methods  and  data  used  in  the  analysis. 

A  step  by  step  description  of  how  the  model  was  built  is  documented  in 
the  Appendix  entitled  "Essential  Elements  of  Analysis." 

At  our  request  our  methodology  and  conclusions  have  been  reviewed 
by  Professor  Martin  K.  Starr  of  the  Graduate  School  of  Business  of 
Columbia  University.  He  judged  our  statistical  procedures  sound 
and  the  conclusions  acceptable  on  a  statistical  and  analytic  basis. 

The  findings  in  this  report  are  not  to  be  construed  as  an  official 
Department  of  the  Army  position,  unless  so  designated  by  other  authorized 
documents. 
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EXECUTIVE  SUMMARY 


OBJECTIVES 

4J 

The  principal  objective  of  this  modeling  project  was  to  measure  adver¬ 
tising's  Impact  on  recruiting  In  terms  of  both  quantity  and  quality  of 
recruits.  The  secondary  objectives  were  to  determine  the  Importance  of 
the  other  major  factors  and  to  analyse  the  Impact  of  media  alternatives. 

RESULTS  ) 

/'The  project  has  been  successful  in  that  these  objectives  have  been  met: 
advertising  payout  has  been  measured  according  to  target  group,  the 
importance  of  six  other  factors  has  been  quantified,  and  although  avail¬ 
able  data  was  limited,  some  indication  of  media  differences  was  developed. 

METHOD 

the  methodology  employed  followed  standard  econometric  practices.  A 
list  of  measurable  variables  was  developed  and  data  concerning  those 
variables  was  compiled.  The  analysis  covers  the  five-year  period  of 

1976-1980o 

Exam-taking  by  prospects  was  chosen  as  the  criterion  against  which  we 
directly  measured  advertising's  effects  because  exam-taking  occurs 
fairly  early  In  the  recruiting  process:  after  the  first  contact  with 
the  recruit,  but  before  the  critical  negotiating  session  between  the 
prospect  and  the  career  counselor.^ 

He  next  built  models  that  explained  the  effect  of  the  GI  Bill,  youth 
unemployment,  seasonality,  the  minimum  wage,  starting  pay,  recruiting 
objectives  and  the  number  of  recruiters.  Two  exam-taking  models  were 
built:  one  for  the  smarter  than  average  prospect  (Mental  Category  I- 
IIIA)  and  a  second  for  the  less  smart  prospects  (Mental  Category  - 
IIIB-IV). 

Once  most  of  the  variations  in  exam-taking  were  explained  by  these 
factors,  we  anaylzed  the  effects  of  advertising  on  the  residual  exam- 
taking.  Each  advertising  medium  (TV,  radio,  etc.)  was  examined  one  at  a 
time. 

The  advertising  and  non-advertising  effects  were  then  jointly  estimated 
and  validated.  Stage  I  In  Figure  1  summarizes  these  models  In  flow  chart 
form.  Stage  II  of  the  analyses  involved  linking  exams  to  accessions. 
Accession  records  were  reviewed,  and  each  accession  was  allocated  to  the 
month  in  which  the  enlistment  contract  was  signed.  This  is  effectively 
a  contract  series,  exclusive  of  those  contracts  that  do  not  result  in 
final  accession.  To  our  knowledge,  this  is  the  first  time  that  recruiting 
performance  has  been  measured  using  a  criterion  so  far  "upstream”  In  the 
recruiting  process. 
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Figure  1.  The  Models  lo  Flow  Chart  Form 
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KEY  FINDINGS 


The  key  findings  of  the  study  ere  summarized  below.  In  arriving  at  these 
findings  we  assumed  that  omitted  variables  were  not  dominating  Influences, 
that  past  (1976*1980)  relationships  will  persist,  and  that  all  factors 
will  stay  relatively  close  to  their  observed  ranges. 

Advertising  Effects  Differ  by  Target  Group. 

Advertising  effects  differ  by  mental  group.  The  number  of  recruits 
from  each  mental  group  that  access  as  a  result  of  advertising  varies, 
as  does  the  time  lag  between  their  exposure  to  advertising  and  their 
actual  accession* 

Some  mental  category  I-IIIA  prospects  are  affected  by  TV,  newspaper  and  local 
advertising  almost  Immediately  (In  the  month  of  exposure  or  one  month  later), 
while  others  demonstrate  a  delayed  response,  generated  by  all  measured  media 
used  In  the  campaign. 

Mental  category  IIIB-IV  prospects  ere  affected  by  all  media  In  the 
campaign  up  to  five  months  after  Exposure. 

Effects  Of  An  Extra  $1,000,000  Of  Advertising. 

Advertising  effects  on  CAT  IIIB,  NHSDG  contrects  were  assumed  to  be 
limited  because  we  are  offered  more  of  such  prospects  than  we  wish  to 
accept.*  Therefore,  the  effect  of  an  extra  $1.0MM  In  advertising  funds 
was  calculated  considering  the  three  remaining  groups:  1-IIIA  HSDG, 

IIIB— IV  HSDG,  and  I-IIIA  NHSDG.  Figure  2  shows  what  an  extra  $1,000,000 
in  media  expenditures  would  have  bought  in  1980,  and  Table  1  shows  the 
corresponding  cost  per  recruit. 

Relative  Cost-Effectiveness  Of  Advertising. 

Advertising  Is  a  more  cost-effective  way  of  Increasing  quality  accessions 
than  Increasing  pay  or  Increasing  the  number  of  recruiters.  This  conclusion 
follows  from  an  economic  analysis  of  what  would  have  happened  if  we  had  in¬ 
creased  each  factor  In  the  model,  one  at  a  time,  to  10Z  above  Its  FY  80  level 
while  holding  all  other  factors  at  their  actual  FY  80  levels.  The  amount  and 
cost  of  each  10Z  change,  as  well  as  the  resulting  Incremental  accessions, 
are  seen  In  Table  2. 

Although  a  10Z  Increase  in  starting  pay  would  net  twice  as  many  recruits  as 
Incrementing  advertising  by  the  same  percentage,  it  would  be  much  more  costly 
than  Increasing  advertising.  An  Increase  in  advertising  is  10  times  as 
cost-effective  as  an  Increase  in  starting  pay,  and  is  twice  as  efficient  as 
increasing  the  recruiter  force  (for  detail,  see  Chapter  6  in  the  main  report) 


*0ur  objective  was  to  measure  the  effects  of  advertising  on  quality  acces¬ 
sions;  therefore,  we  spent  little  time  analyzing  the  IIIB-IV  NSHDG  group* 
This  group  was  considered  to  be  more  constrained  by  the  demands  of  the  Army 
than  by  the  supply  of  candidates,  because  accession  variation  reflects  ad¬ 
ministrative  pressures  as  much  as  the  response  to  marketing  efforts. 


HSDG 

I-IIIA 

300 


Figure  2.  An  Extra  $1,000,000  Buys  800  Quality  Acceselona 


Table  1.  Estlaated  Advertising  Coat  Per  Recruit 


Market  Segment 


Cost  per 
Recruit 


CAT  I-IIIA,  HSDG  $  3,300 

ANT  HSDG  $  1,500 

ANT  HSDG  or  CAT  I-IIIA,  «SDG  $  1,250 


,r 


Table  2.  Relative  Coat-Effectiveness  of  Advertising 
(Impact  of  10Z  Changes) 


Incremental  Access lone 


Amount  of  Change 

CAT  I-IIIA 

any 

CAT  I-IIIA, 
NHSDG  or  any 

change 

cost  ($MM) 

HSDG 

HSDG 

HSDG 

Unemployment 

1.7  points 

— 

2,400 

4,200 

5,200 

Minimum  Wage 

+3U/hr. 

— 

-2,300 

-4,400 

-5,400 

Starting  Pay 

$44/mo. 

$72* 

2,300 

4,400 

5,400 

lecrulter  Force 

533  bodies 

$16** 

2,200 

5,842 

6,740 

Total  Objectives 

1,100/mo. 

— 

-1,800 

-5,200 

-5,000 

Advertising 

— 

$  3 

900 

2,000 

2,400 

(in  1980  dollars) 


*  Starting  Pay  Budget  *  $720. OHM/ year 

**lecrultars  each  cost  $30, 000/year. 


The  C.  I.  Bill  vu  an  important  recruit lag  tool*  the  teralnetioa  of  which 
had  a  significantly  negative  impact  on  accessions,  as  illustrated  in 
Table  3. 


The  impact  of  restoring  the  C.I.  Bill  cannot  be  projected*  however*  since 
its  termination  coincided  with  major  policy  changes  and  budget  cuts  that 
also  affected  accessions*  In  addition*  the  program's  30-year  history  and 
universal  awareness  further  complicate  any  attempts  at  predicting  the 
effects  of  restoration. 

Table  3*  Effect  of  Terminating  the  61  Bill 
(by  Market  Segment) 

Market  Segment 

CAT  I-IIIA,  HSDG  - 
Any  HSDG  - 
CAT  I-IIIA,  HHSDC  or 
any  HSDG  - 


Effect  of  Change  in  Total  Objectives. 

The  model  shows  us  that  Increased  "pressure”  via  Increased  quantity  objectives 
produces  more  exams*  but  fewer  quality  accessions*  and  has  historically* 
therefore*  been  costly  and  counter-productive. 


Effect  on  Accessions 

down  ll*000/year 
down  22* 000/year 

down  27* 000/year 


Table  A.  Effect  of  10Z  Increase  in  Recruiting  Objectives 


Market  Segment  Z  of  change  in  quality  accessions 

CAT  I-IIIA,  HSDG  -  5Z 
Any  HSDG  -10Z 
Any  HSDG  or  CAT  I-IIIA,  HHSDG  -  5Z 


Exams  to  Accessions  Conversion  Bate. 


In  the  course  of  the  linkage  analysis*  we  noted  a  fairly  stable  exams-to- 
accesslons  conversion  rate*  as  Illustrated  below.  An  increase  in  this  con¬ 
version  rate  may  well  be  the  most  cost-effective  way  to  inprove  quantity 
and  quality  simultaneously.  As  detailed  analysis  is  outside  the  scope  of 
this  contract*  we  suggest  additional  study. 


-  7  - 

Table  5*  Conversion  lata:  Long-Tan  Averages 
(Monthly) 


1 

Known* 

HS  Status 

Estimated*' 
HS  Status 

Contracts 

Estimated* 

"Conversion" 

CAT  I-IIIA 

7,000 

HSDG  50Z 

60Z 

2,620 

63Z 

HSDG  50Z 

40Z 

1,570 

56Z 

CAT  IIIB-IV 

13,800 

HSDG  34Z 

40Z 

3,300 

60Z 

NHSDG  66Z 

60Z 

3,000 

N/A 

•Note  that  HSD6  status  cannot  be  determined  prior  to  accession  because 
data  systems  collect  "years  of  education  completed." 


Model  Reliability  and  Validation. 


The  model  passed  all  of  the  standard  tests  with  good  results.  He  are 
confident  that  the  major  process  dynamics  have  been  correctly  described. 
Statistical  tests  of  the  model  validity  have  been  successful:  85-90Z 
of  variances  have  been  explained,  there  Is  no  auto-correlatlon  in 
exams  residuals,  and  all  "t"  values  are  in  excess  of  2.0. 


In  addition,  variables  have  been  systematically  excluded  to  double-check 
their  Impact,  and  a  split-half  analysis  has  been  performed  to  measure  the 
stability  across  time.  The  results  show  that  this  model  Is  both  reliable 
and  stable  and  can  be  uaed  for  forecasting  purposes. 


CONCLUSIONS 

All  factors  studied  had  statistically  significant  Impacts.  The  Impact  of  adver¬ 
tising  Is  delayed  and  varies  by  mental  category.  Advertising  was  found  to 
be  the  moet  coet-effectlve  tool  studied  (within  the  range  of  the  data). 

HO  also  found  that  the  effecta  of  restoring  the  61  Bill  are  not  projectable, 
and  that  Increasing  total  quantity  objectives  puts  pressure  on  recruiters 
that  la  counter-productive  In  terms  of  quality.  Finally,  we  found  that  the 
model's  reliability  Is  good. 
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